Discovery of Optimal Backpropagation Learning Rules Using Genetic Programming
نویسندگان
چکیده
The development of the backpropagation learning rule has been a landmark in neural networks. It provides a computational method for training multilayer networks. Unfortunately, backpropagation suffers from several problems. In this paper, a new technique based upon Genetic Programming (GP) is proposed to overcome some of these problems. We have used GP to discover new supervised learning algorithms. A set of such learning algorithms has been compared with the Standard BackPropagation (SBP) learning algorithm on different problems and has been shown to provide better performances. This study indicates that there exist many supervised learning algorithms better than, but similar to, SBP and that GP can be used to discover them.
منابع مشابه
Discovery of Neural Network Learning Rules Using Genetic Programming
Using Genetic Programming Amr Mohamed Radi and Riccardo Poli School of Computer Science The University of Birmingham Birmingham B15 2TT, UK E-mail: fA.M.Radi,[email protected] Technical Report CSRP-97-21 September 3, 1997 Abstract The development of the backpropagation learning rule has been a landmark in neural networks. It provides a computational method for training multilayer networks. ...
متن کاملThe Introduction of a Heuristic Mutation Operator to Strengthen the Discovery Component of XCS
The extended classifier systems (XCS) by producing a set of rules is (classifier) trying to solve learning problems as online. XCS is a rather complex combination of genetic algorithm and reinforcement learning that using genetic algorithm tries to discover the encouraging rules and value them by reinforcement learning. Among the important factors in the performance of XCS is the possibility to...
متن کاملThe Introduction of a Heuristic Mutation Operator to Strengthen the Discovery Component of XCS
The extended classifier systems (XCS) by producing a set of rules is (classifier) trying to solve learning problems as online. XCS is a rather complex combination of genetic algorithm and reinforcement learning that using genetic algorithm tries to discover the encouraging rules and value them by reinforcement learning. Among the important factors in the performance of XCS is the possibility to...
متن کاملUse of Genetic Programming for the Search of a New Learning Rule for Neural Networks
| In previous work ((1, 2, 3]) we explained how to use standard optimization methods such as simulated annealing, gradient descent and genetic algorithms to optimize a parametric function which could be used as a learning rule for neural networks. To use these methods, we had to choose a xed number of parameters and a rigid form for the learning rule. In this article, we propose to use genetic ...
متن کاملDiscovering Efficient Learning Rules for Feedforward Neural Networks using Genetic Programming
The Standard BackPropagation (SBP) algorithm is the most widely known and used learning method for training neural networks. Unfortunately, SBP suffers from several problems such as sensitivity to the initial conditions and very slow convergence. Here we describe how we used Genetic Programming, a search algorithm inspired by Darwinian evolution, to discover new supervised learning algorithms f...
متن کامل